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conferencing decoders is considered. The capacity region is characterized in the special cases of physically 
degraded channels and unidirectional cooperation, and achievable rate regions are provided for the general 



("^ ' case. The results are then extended to the corresponding Gaussian model. In the Gaussian setup, the provided 



achievable rates are shown to lie within some constant number of bits from the boundary of the capacity 
region in several special cases. An alternative model, in which the encoders are connected by conferencing 
^^ . links rather than having a common message, is studied as well, and the capacity region for this model is 

j^ ' also determined for the cases of physically degraded channels and unidirectional cooperation. Numerical 

results are also provided to obtain insights about the potential gains of conferencing at the decoders and 
encoders. 
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I. Introduction 

In today's complex communication networks there are often multiple "signal paths" to utilize in 
delivering data between a given transmitter and receiver. Such signal paths may take the form of 
(generalized) feedback from the channel to the transmitters or additional (orthogonal) communica- 
tion links between either the transmitters or the receivers. The first case corresponds to scenarios 
in which the additional signal paths share the spectral resources with the direct transmitter-receiver 
links (in-band signalling), while the second case refers to scenarios in which orthogonal spectral 
resources are available at the transmit and/or the receive side (out-of-band signalling). 

In this work, we focus on the latter case discussed above and model the out-of-band signal paths 
as finite-capacity directed links. This framework is typically referred to as "conferencing" (or "partial 
cooperation") in the literature to emphasize the possibly interactive nature of communication on such 
links. Conferencing encoders in a two-user multiple access channel (MAC) have been investigated 
in [1] [2]j and in [3] for a two-user interference channel. These works show that conferencing 
encoders can create dependence between the transmitted signals by coordinating the transmission 
via the out-of-band links, thus mimicking multiantenna transmitters. Conferencing decoders have 
been studied in [4] for a relay channel and in [5] - [9] for a broadcast channel. Such decoders 
can use the out-of-band links to exchange messages about the received signals so as to mimic a 
multiantenna receiver (see also [10]). 

This work extends the state of the art described above by considering the compound MAC 
with conferencing decoders and a common message (see Fig. [I]) and then with both conferencing 
encoders and decoders (see Fig. [5]). These models generalize the setup of a single-message broadcast 
(multicast) channel with two conferencing decoders studied in [5j3 - [9], in that there are two 
transmitters that want to broadcast their messages to the conferencing receivers. Moreover, the 
transmitters can have a common message (Fig. [T]) or be connected by conferencing links (Fig. 
15]). The model also generalizes the compound MAC with common messages studied, among other 
models, in [3], by allowing conferencing among the decoders. The main contributions of this work 

'it is noted that a MAC with conferencing encoders can be seen as a special case of a MAC with generalized feedback. 
^Reference [5] also considers a broadcast channel with private messages to the two users. 



are summarized as follows: 

• The capacity region is derived for the two-user discrete-memory less compound MAC with 
a common message and conferencing decoders in the special cases of physically degraded 
channels and unidirectional cooperation (Sec. HVT) : 

• Achievable rate regions are given for the general model of Fig. [1] (Sec. IVT ); 

• Extension to the corresponding Gaussian case is provided, establishing the capacity region 
with unidirectional cooperation and deriving general achievable rates. Such achievable rates 
are also shown to be within some constant number of bits of the capacity region in several 
special cases (Sec. IVTl) : 

• The capacity region is determined for the compound MAC with both conferencing encoders 
and decoders as in Fig. [5] in the special cases of physically degraded channels and unidirectional 
cooperation (Sec. I VIII) . 

Finally, numerical results are also provided to obtain further insight into the main conclusions. 

II. System Model and Main Definitions 

We start by considering the model in Fig. [H which is a discrete-memory less compound MAC 
with conferencing decoders and common information (here, for short, we will refer to this channel 
as the CM channel). The CM channel is characterized by {Xi, X2, p*{yi,y2\xi,X2), 3^i, 3^2) with 
input alphabets Xi, X2 and output alphabets 3^i, 3^2- The ith encoder, i = 1, 2, is interested in sending 
a private message Wi G Wj = {1, 2, ..., 2"^'} of rate Ri [bits/channel use] to both receivers and, in 
addition, there is a common message Wq E Wq = {1,2,..., 2'^^°} of rate Rq to be delivered by both 
encoders to both receivers. The channel is memoryless and time-invariant in that the conditional 
distribution of the output symbols at any time j = 1,2, ...,n satisfies 

Pivij, Z/2,j|a;i , X2 , yi'^, yi'^, w) = p*iyi,j, y2,j\xi,j, X2j) (1) 

with w = {wo,wi,W2) E Wo x Wi x W2 being a given triplet of messages. Notation-wise, we 
employ standard conventions (see, e.g., [11]), where the probability distributions are defined by the 
arguments, upper-case letters represent random variables and the corresponding lower-case letters 
represent realizations of the random variables. The superscripts identify the number of samples to be 



included in a given vector, e.g., y{' = [yi^i ■ ■ ■ yi,j-i]. It is finally noted that the channel defines the 
conditional marginals p{yi\xi,X2) = ^y^(zy^ P*{yi-, 1/2^1, X2) and similarly for ^(^2^1, X2). Further 
definitions are in order. 

Definition 1: A ((2"^", 2"-^^, 2"^^-) ,^ /^) code for the CM channel consists of two encoding 
functions (i = 1, 2) 

/,: Wo X W. ^ a;", (2) 

a set of 2K "conferencing" functions and corresponding output alphabets Vj,fc {k = 1,2, ...,K): 

gi,k- 3^r X V2,i X ■ • ■ X V2,fc_i -^ Vi,fc (3a) 

g2,k: 3^2" X Vi,i X ■ ■ ■ X Vi,fc-i ^ V2,fc, (3b) 

and decoding functions: 

hi. 3^r X V2,i X ■ ■ ■ X V2,K ^ Wo X Wi (4a) 

/i2: 3^2" X Vi,i X ■ ■ ■ X Vi,i^ ^ Wo X W2. (4b) 

Notice that the conferencing functions ([3]) prescribe K conferencing rounds between the decoders 
that start as soon as the two decoders receive the entire block of n output symbols y" and 1/2 . 
Each conference round, say the fcth, corresponds to a simultaneous and bidirectional exchange of 
messages between the two decoders taken from the alphabets Vi^^ and V2,fc: similarly to [1], [14]. It 
is noted that other works have used slightly different definitions of conferencing rounds [7], [16]. 
After the K conferencing rounds, the receivers perform decoding with functions (H)) by capitalizing 
on the exchanged conferencing messages. Due to the orthogonality between the main channel and 
the conferencing links, the transmission from the users on one channel and conferencing/ decoding 
on the other can take place simultaneously. 

Definition 2: A rate triplet {Rq, Ri, R2) is said to be achievable for the CM channel with decoders 
connected by conferencing links with capacities (C12, C21) (see Fig. [T]) if for any e > there exists, 
for all n sufficiently large, a ((2"^°, 2"^^, 2''^^^),n, K) code with any i^ > such that the probability 
of error satisfies 
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Fig. 1. A discrete-memoryless compound MAC channel with conferencing decoders and common information (for short, CM). 
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and the conferencing alphabets are such that 
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The capacity region CcuiCu, C21) is the closure of the set of all achievable rates (i?o, -Ri, -R2)- 

III. Preliminaries and an Outer bound 

Similarly to [3], it is useful to define the rate region 'TlMAc,i{p{u) , p{xi\u) , p{x2\u)) for the MAC 
seen at the ith receiver (i = 1, 2) as the set of rates 

T^MAC,i{pi'<^)^Pi^l\'^),Pi^2\u)) = \ {Ro,Rl,R2)-Ro > 0, i?i > 0, i?2 > 0, 



(7a) 
(7b) 
(7c) 

(7d) 



i?i</(Xi;r,|X2f/), 

R2<I{X2;nx,U), 

R, + R2<I{X^X2;nU), 

Ro + Ri + R2<I{XiX2;Yi)\, 
where the joint distributions of the involved variables is given by 

p{u)p{xi\u)p{x2\u)p{yi\xi,X2). 



If Ci2 = C21 = 0, the capacity region Ccm{0, 0) is given by [3]: 

Ccm{0,0) = U ^ n '^MAcMu),pixi\u),p{x2\u)) I (8a) 

U=l,2 J 

= |j|(/?o,i?i,i?2): Ro >0, Ri> 0, R2 > 0, 



(8b) 

Ri < min{/(Xi; Fi|X2f/), /(Xi; rslXst/)}, (8c) 

i?2 < min{/(X2; Fi|Xif/), /(X2; FslXi^/)}, (8d) 

Ri + R2< min{/(XiX2; Fi|f/), /(X1X2; Fsif/)}, (8e) 

Ro + Ri + R2< min{/(XiX2; Fi), /(X1X2; K,)}}, (8f) 

where the union is taken over all joint distributions of the form 

p{u)p{xi\u)p{x2\u)p*{yi,y2\xi,X2). 

It is remarked that no convex hull operation is necessary in ([8]) as the region Cca/(0, 0) is convex 
[3] (see also [1], Appendix U). 

We now derive an outer bound on the capacity region Ccm{Ci2, C21). To this end, it is useful to 
define the capacity region achievable when the two receivers are allowed to fully cooperate (FC), 
thus forming a two-antenna receiver. In this case, we have 

nMAc,Fc{p{u),p{xi\u),p{x2\u)) = | (i?o, ^1, ^2):i?o > 0, i?i > 0, i?2 > 0, (9a) 

Ri<I{Xi-YiY2\X2U), (9b) 

R2<I{X2-,Y,Y2\X,U), (9c) 

Ri + R2<I{X,X2;Y{Y2\U), (9d) 

Ro + Ri + R2< /(X1X2; ^1^2)}, (9e) 

where the joint distributions of the involved variables is given by 

p{u)p{xi\u)p{x2\u)p*{yi,y2\xi,X2). (10) 



Proposition 3.1: We have Ccm{Ci2, C21) C CcM-o«t ((^12 , C21) where (dropping the dependence 
on p{u),p{xi\u),p{x2\u) to simplify the notation) 

CcM-out{Ci2, C21) = [J{(7^MAc,i + C12) n {TZmac,2 + C21) H (TZmacfc)} (H^) 

= [jURo,Ri,R2y. Ro>0, Ri>0, R2>0, (lib) 

i?i < min{/(Xi; FilXsf/) + C21, I{X,; Fsl^st/) + Cu, 

I{X^;Y,Y2\X2U)}, (lie) 
i?2 < min{/(X2; Y,\XiU) + C21, /(X2; Y2\X^U) + C12, 

/(X2;rir2|Xif/)}, (lid) 

Ri + R2< min{/(XiX2; Filf/) + C21, /(X1X2; F2|f/) + ^^12, (He) 

I{X^X2;Y,Y2\U)}, (llf) 
i?o + i?i + i?2 < min{/(XiX2; Yi) + C21, /(X1X2; F2) + C12, 

/(XiX2;FiF2)}l, (llg) 



in which the union is taken over all the joint distributions that factorize as (fTO|) . 
Similarly to ([8]), region (fTTI) can be proven to be convex following [1]. 
Proof: See Appendix HI ■ 

IV. Capacity Region with Physically Degraded Channels and Unidirectional 

Cooperation 

The next proposition establishes the capacity region Ccm-deg{Ci2-, C21) in the case of physically 
degraded outputs. 

Proposition 4.1: If the CM channel is physically degraded in the sense that (X1X2) — Y1—Y2 



forms a Markov chain, then the capacity region is obtained as 

CcM-DEGiCi2,C2l) = CcM-out{Cl2,0) = (12a) 

= [jiiRo, Ru R2): Ro >0, Ri> 0, R2 > 0, (12b) 

i?i < min{/(Xi; Y.lX^U), I{X,- FslXsf/) + C12}, (12c) 

R2 < min{/(X2; Y,\X^U), /(X2; Y^lX^U) + C12}, (12d) 

Ri + R2<mm{I{X,X2;Yi\U), I{X,X2;Y2\U) + Cu}, (12e) 

i?o + i?i + i?2 < min{/(XiX2; ^i), /(X1X2; 1^2) + C12}}. (12f) 

Notice that here j5*(?/i?/2|a;i,a;2) = p{yi\xi, X2)p{y2\yi) due to degradedness. 

Proof: See Appendix HIl ■ 

Remark 4.1: A symmetric result clearly holds for the physically degraded channel (X1X2) — 
Y2 - Fi. 

Establishment of the capacity region is also possible in the special case where only unidirectional 
cooperation is allowed, that is C12 = or C21 = 0. This result is akin to [9] where a broadcast 
channel with two receiver under unidirectional cooperation was considered. 

Proposition 4.2: In the case of unidirectional cooperation (C12 = or C21 = 0), the capacity 
region of the CM channel is given by 

Ccm(0,C2i) = CcAf-oMt(0, C21) (13) 

or 

CcMiCu, 0) = CcM-outiCu, 0). (14) 

Proof: Achievability follows by using the same scheme as in the proof of Proposition 14.11 
The converse is immediate. ■ 

V. General Achievable Rates 

Achievable rates can be derived for the general CM channel, extending the analysis of [5] from 
the broadcast setting with one transmitter to the CM channel. Notice that [5] uses a different 



definition for the operation over the conferencing channels but this turns out to be immaterial for 
the achievable rates discussed below. 

Proposition 5.1: The following region is achievable with one-round conferencing, i.e., K = 1: 

noRiCu, C21) = |J{(i?o, Ri, R2): Ro >0, Ri> 0, R2 > 0, (15a) 

i?i < min{/(Xi; FifslXaf/), /(Xi; Y^Y^lX^U)}, (15b) 

R2 < min{/(X2; Y.Y^lX.U), /(X2; Y^Y.lX.U)}, (15c) 

Ri + R2< min{/(XiX2; Y,%\U), /(X1X2; Y^Y.lU)} (15d) 

Ro + Ri + R2< min{/(XiX2; Y^Y^), /(X1X2; ^2^1)}} (15e) 

subject to 

Ci2>I{Y,;Y,\Y2) (16a) 

C2i>IiY2;Y2\Y,) (16b) 

with |3^i| < |3^i| + 1, and the union is taken over all the joint distributions that factorize as 

p{u)p{xi\u)p{x2\u)p*{yi,y2\xi,X2)piyi\yi)piy2\y2)- 
Proof: (Sketch): The proof is similar to that of Theorem 3 in [5] and is thus only sketched here. 
A one-step conference (K = 1) is used. Encoding and transmission are performed as for a MAC 
with common information (see proof of Proposition 14.11) . Each receiver compresses its received 
signal using Wyner-Ziv compression exploiting the fact that the other receiver has a correlated 
observation as well. The compression indices are exchanged during the one conferencing round 
via symbols Vi,i and V2,i. Decoding is then carried out at each receiver using joint typicality: 
For instance, receiver 1 looks for jointly typical sequences (^"(wo), a;"(wo, wi), X2 (wo, W2)-,y\-, ilT) 
with Wi G Wi, where ^2 i^ the compressed sequence received by the second decoder. ■ 

The achievable strategy of Proposition 15. II is based on i^ = 1 round of conferencing. It is easy 
to construct examples where such a strategy fails to achieve the outer bound (fTT)) as discussed in 
the example below. 

Example 1. Consider a symmetric scenario with Rq = and equal private rates Ri = R2 = R 
{i.e.,p*{yi,y2\xi,X2) = p*{y2,yi\xi,X2) = p*{yi,y2\x2,xi) = p* (1/2, 2/1 |a;2,a;i)). Fix t/ to a constant 



without loss of generality (given the absence of a common message) and the input distribution to 
p{xi)p{x2). We are interested in finding the maximum achievable equal rate Ri = R2 = R. Assume 
that the conferencing capacities satisfy Cu = H(Yi\Y2) = H(Y2\Yi) and 1/2 ■ /(X1X2; F2|^i) < 
C21 < H(Yi\Y2). In this case, it can be seen that the maximum equal rate is upper bounded as 
R < Rout = 1/2 ■ -^(-^1-^2; ^1^2) by the outer bound (fTTl) . which corresponds to the maximum 
equal rate of a system with full cooperation at the receiver side. This bound can be achieved if both 
receivers have access to both outputs Yi and Y2. With the one-round strategy, since Cu = H{Yi\Y2) 
receiver 1 can provide Fi to receiver 2 via Slepian-Wolf compression, but receiver 2 cannot do 
the same with receiver 1 since C21 < H{Yi\Y2). Therefore, rate Rout cannot be achieved by this 
strategy, which in fact attains equal rate Rqr = 1/2 • -^(-^1-^2; ^1^2) < Rout (recall (fT6l)). 

We now consider a second strategy that generalizes the previous one and is based on two rounds 
of conferencing (K = 2). As will be shown below, this strategy is able to improve upon the 
one-round scheme, while still failing to achieve the outer-bound (fTTl) in the general case. 

Proposition 5.2: The following rate region is achievable with two rounds of conferencing, i..e., 
K = 2: 

7^T/^(C^l2, C21) = co|J{7^T/^,l2 U 7^T/^,2l} (17) 

where "co" indicates the convex hull operation, and we have 

TItr^u = {{Ro, Ri, R2): Ro > 0, i?i > 0, R2 > 0, (18a) 

i?i < mm{I{X,;Y,\X2U) + C2i, I{X,;Y2Y,\X2U)}, (18b) 

R2 < mm{I{X2; Yi\X,U) + C21, /(X^; Y2Yi\XiU)}, (18c) 

Ri + R2< min{/(XiX2; Yi\U) + C21, /(X1X2; Y2Yi\U)}, (18d) 

Ro + R^ + R2< min{/(XiX2; Y,) + C21, /(X1X2; ^2^1)}}, (18e) 



TlTRfli is similarly defined: 

7^TR,2l = {(i?o, i?i, R2): Ro >0, Ri> 0, R2 > 0, (19a) 

R, < min{/(Xi; FiFsl^sf/), I{X^; Y^lX^U) + C^}, (19b) 

R2 < min{/(X2; FifslXif/), /(Xi; Fsl^sf/) + C12}, (19c) 

i?i + i?2 < min{/(XiX2; Y.Y^lU), I{X,; Fsl^sf/) + C,^}, (19d) 

i?o + i?i + i?2 < min{/(XiX2; ^^2), /(^i; ^21^2) + C12}}, (19e) 



subject to 

Ci2>/(Fi;Fi|F2) 
C2i>/(F2;F2|n) 
with |3^i| < |3^i| + 1, and the union is taken over all the joint distributions that factorize as 

p{u)p{xi\u)p{x2\u)p*{yiy2\xi,X2)piyi\yi)piy2\y2)- 
Proof: (Sketch): The proof is quite similar to Theorem 4 in [5], and here we only sketch 
the main points. Conferencing takes place via K = 2 conferencing rounds. Moreover, two possible 
strategies are considered, giving rise to the convex hull operation in (flTl) by time-sharing. The two 
corresponding rate regions TZtr,i2 in (fTSi) and TItr,2i in (fT9l ) are obtained as follows. Consider 
T^TB.,12- Receiver 2 randomly partitions the message sets Wo, Wi and W2 into 2"""'"i2^ 2"°i'^i2 ^^^ 
2na2Ci2 subsets, respectively, for a given < ctj < 1 and J2i=o '^i = I5 ^^ i'^ the proof of Proposition 
14. 1[ Encoding and transmission are performed as for the MAC with common information. Receiver 
1 compresses its received signal using Wyner-Ziv quantization as for the scheme discussed in the 
proof of Proposition 15. 1[ This index is sent in the first conferencing round (notice that |Vi,i| = nCu 
and |V2,i| = 0). Upon reception of the compression index Vi,i, receiver 2 proceeds to decoding via 
joint typicality and then sends the subset indices (see proof of Proposition 14.11) to receiver 1 via 
V2,2 (now, |Vi,2| = and |V2,2| = nC2i). The latter decoder performs joint-typicality decoding on 
the subsets of messages left undecided by the conferencing message Vi,i received by 1. The rate 
region TZtr,2i is obtained similarly by simply swapping the roles of decoder 1 and decoder 2. ■ 



Example 1 (cont'd): To see the impact of the two-round scheme, here we reconsider Example 
1 discussed above. It was shown that, for the scenario discussed therein, the one-round scheme 
is not able to achieve the outer bound Rout- However, it can be seen that the two-round scheme 
does indeed achieve the outer bound. In fact, receiver 1 can provide Yi to receiver 2 via Slepian- 
Wolf compression as for the one-round case, while receiver 2 does not send anything in the first 
conferencing round (I2 is a constant). Now, receiver 2 decodes and sends the bin index of the 
decoded messages to receiver 1 in the second conferencing round according to the two-round 
strategy discussed above (receiver 1 is silent in the second round). Since C21 > l/2-I(XiX2; ^2|^i) 
by assumption, it can be seen from Proposition 15.21 that the maximum equal rate achieved by the 
two round scheme is Rtr = Rout- 

We finally remark that it is possible in principle to extend the achievable rate regions derived 
above to more than two conferencing rounds, following [6] [7]. This is generally advantageous 
in terms of achievable rates. While conceptually not difficult, a description of the achievable rate 
region would require cumbersome notation and is thus omitted here. 

VI. Gaussian Compound MAC 
Here we consider the Gaussian version of the CM channel: 

Yi = 711X1 + 721X2 + Zi (20a) 

Y2 = 722X2 + 712X1 + Z2, (20b) 

with channel gains 7jj > 0, independent white zero-mean unit-power Gaussian noise {Zi}"^-^ 
and per-symbol power constraints i?[Xf] < Pj. Notice that the channel described by (|20l) is not 
physically degraded. 

The outer bound of Proposition 13.11 can be extended to (|20l) by using standard arguments. In 
particular, the capacity region of the Gaussian CM, C^j^^(Ci2, C21) satisfies the following. 



Proposition 6.1: We have C^^^(Ci2, C21) ^ C^ m -outi.^ 12, C 21) where: 



^CM-o«t (C12, (^21^ 



U |(i?o,i?i,i?2):i?o > 0, i?i > 0, i?2 > 0, 



0<Pl<P, 
i=l,2 



R, < mill {C(7i\P0 + C21, C(7LpO + C12, C(A' {^f, + ^l^))} 

R2 < mill {C(72\P2) + C21, ^(72^2^2) + Cu, C{P^ (721 + 722))} 

C(7fii^i + 7li^2) + C21, C(7i2^2 + 7?2^i) + C12, 
C {Pi (7fi + 7?2) + P^ ill + 1I2) + /C) 



Ri + R2 < mill 



(21a) 

(21b) 
(21c) 

(21d) 



Ro + Ri + R2 < mill < 



with 



CillPi + 7li^2 + Pi) + C21, C(7|2^2 + 7?2A' 
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C +pi (1 + P{722 + P!^^l^) + p2(l + Pi'7?i - 

^^ -2VPiP2(-Pi'7ii7i2 + -P2 721722) 



/C = ^1^2(712721 - 711722)^ 
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P2) + C12, 
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P^7ii) 
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Lf 



(711 VA - Pi + 721 VP2 - P 

{l22^P2-P2 + ll2^Pl-P[f 



{lid.) 

(22b) 

(22c) 



andC(x) = |log(l + x). 

Proof: Similarly to Proposition I3.1[ one can prove that the rate region ([TT]) is an outer 
bound on the achievable rates. It then remains to be proved that a Gaussian joint distribution 

p{u)p{xi\u)p{x2\u) with Xi = 



'P — P[\J + a/P/V^i, where is f/, V\ and V2 are independent 
Gaussian zero-mean unit-power random variables, is optimal. This can be done following the steps 
of [2], where the proof is given for a single MAC channel with common information (see also 
[15]). The proof is concluded with some algebra. ■ 

The achievable rates in Proposition 15.11 (for K = Y) and Proposition 15.21 (for K = 1) can also be 
extended to the Gaussian CM channel. In so doing, we focus on jointly Gaussian auxiliary random 
variables for Wyner-Ziv compression. While no general claim of optimality is put forth here, some 
conclusion on the optimality of such schemes can be drawn as discussed later in Sec. IVI-AI 



Proposition 6.2: The following rate region is achievable with one-round conferencing, K 



7^Si^(Cl2, C21) = U {(i?o, Ri. R2): Ro >0, Ri> 0, R^ > 0, 
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Proof: As stated above, we consider Gaussian auxiliary random variables and evaluate the 

region (flSl) . In particular, the test channels for Wyner-Ziv compression are selected as % = Yi + Zg^i 

where the compression noise Zg^i is zero-mean Gaussian with variance af and independent of Fj. 

The proposition follows from some algebraic manipulation. ■ 

The one-round strategy can be generalized by enabling two rounds of conferencing (K = 2), 

obtaining the following achievable rate region: 



Proposition 6.3: The following rate region is achievable with two rounds of conferencing, K 
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7^TR,i2 is similarly defined: 
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A. Discussion 

Here we draw some conclusions on the optimality of the one and two-round schemes discussed 
above for the Gaussian CM channel. We start with the one-round scheme of Proposition 16.21 and 
notice that, by comparison with the outer bound (|2TI) . it can be easily seen that the scheme at hand 
is optimal in the asymptotic regime of large conferencing capacities C12 -^ 00 and C21 -^ cxd. 
Further conclusions on the gap between the upper bound (|2T]) and the performance achievable with 
one round of conferencing at the decoders can be drawn in two special cases. Consider first the 
case of a broadcast channel with conferencing encoders [5] [7], which is obtained as i?o = and 
i?2 = and thus P2 = without loss of generality (a symmetric statement can be straightforwardly 
obtained for Rq = and -Ri = 0). In this case, we show below that the one-round scheme achieves 
the upper bound (|2T]) to within half a bit, irrespective of the channel gains of the broadcast channel 
and the capacities of the conferencing links. To elaborate, notice that the outer bound (|2T]) for the 
case at hand is given by 



Ri < Ri,out = min{C(7i\Pi) + C21, C{jI^Pi) + Cu, C{{jI + 7?2)A)}, 



(28) 



whereas the rate achievable with one-round conferencing is given by 



where 
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(22^--l)(l+7fii^i) 



(29) 



Using these two expressions, we can prove the following proposition (see Appendix Un] for a full 
proof). 

Proposition 6.4: We have Ri^oR > Ri,out — \- Moreover, for the symmetric channel case, i.e., 
7n = 7?2' we have Ri^qr > Ri,out - ^^^. 

Next, we consider the symmetric Gaussian CM channel, that is, we let Rq = 0, 'jji = 7I2 = a. 



7i2 = 721 = ^' ^^^ Pi = P2 — P- We also assume symmetric conferencing link capacities C12 



C21 = C. In such a case, the outer bound and the achievable rates with one-round conferencing 
are: 

C^cM-out{C) = {{Ru R2) ■■Ri>0, R2> 0, 

i?i < min{C(aP) + C, C{bP) + C, C{{a + 6)P)}, (30a) 

R2 < mm{C{bP) + C, C{aP) + C, C{{a + b)P)}, (30b) 

Ri + R2< min{C((a + b)P) + C, C(2(a + b)P + {b - afP^)}}, (30c) 



and 



KniC) = {{Ri,R2) : i?i > 0, i?2 > 

b_ 



R,<min{C{ {a + ^—^]P),C( (b+y—^]P] }. (31a) 



i?2<min<'C( [b+-^]p],c((a+—^]P] J> , (31b) 



1 + aV / VV 1 + ^ 

with cr^ = ^t-^l^(^_^l)pS2ic_i) , respectively. The following result can be proved (see Appendix HVT). 

Proposition 6.5: 7^g^ 3 {(i?i, R2) : i?i > 0, i?2 > 0, {Ri+5, i?2+(A-(5)) E C^m-ouAC) for all 6 G 
[0, A]} with A = °^^^^^ where [3 = ^f^fej- Moreover, in the special case a = b, the gap A can 
be further reduced to A = (^^^) ^ 0.293 bits. 

The proposition above is equivalent to saying that the total rate loss of using one round of 
conferencing relative to the sum capacity is less than °^^^ •* , which is a constant that depends 
only on the relative qualities of the direct channels and the cross channels. 



Let us now consider the two-round scheme of Proposition l6.3[ Since7^^^(Ci2, C21) ^ '^ok(^i2) C'21), 
all the conclusions above on the one-round scheme apply also to the two-round strategy. Alterna- 
tively, we can interpret these results as a finite bit limit on the potential gain of going from one 
round of conferencing to two rounds. Moreover, it should be noted that the two-round approach 
was defined as single-session in [16] and shown therein to be optimal among several classes of 
multi-session protocols for a broadcast channel with cooperating decoders. Finally, we can prove 
the following. 

Proposition 6.6: The two-round scheme is optimal in the case of unidirectional cooperation: 
n^TRi^, C21) = CgA/-o„t(0, C21) and n^TRiCu, 0) = Cg^,_„„i(Ci2, 0), thus establishing the capacity 
of the Gaussian CM channel for this special case. 

Proof: This result follows by comparing the achievable region with the outer bound (|2T)) . ■ 

Next, we comment on the sum-rate multiplexing gain of the Gaussian CM channel. Consider a 
symmetric system with Pi = P2 = P, 711 = 722, 712 = 721; and C12 = C21 = C. We are interested 
in studying the conditions on the conferencing capacity C such that the maximum multiplexing 
gain on the sum-rate, limp_^oo ^^V(o,Ri,R2)ec^ (c,c)(-^i + -R2)/(| log-P) = 2, corresponding to full 
cooperation, can be achieved. From the outer bound in (|2T1) . it is clear that C should scale at 
least as | logP as the sum rate is limited by C{P{'yJi + 721)) + C- By considering the achievable 
regions with one (l23l) or two (l25l) conferencing rounds, it can be also concluded that if C scales 
as (1 + e)logP with any e > 0, then the optimal multiplexing gain is indeed achievable. This 
is because with C = |(1 + e)logP the quantization noise variances in (|24|) are proportional to 
P^^ and thus tend to zero for large P. It is noted that this result would hold even if the decoders 
used regular compression that neglects the side information at the other decoder, as in this case we 
would have af = '^^ 2^^ ' ^-\ — ' which is still proportional to P^^ for C = |(1 + e) log P. 

As a final remark, extending the achievable rates defined above for the Gaussian channel (and as- 
suming Gaussian channel and compression codebooks as done above) to more than two conferencing 
rounds would not lead to any further gain, since with Gaussian variables, "conditional" compression 
and compression with side information have the same efficiency (see [7] for a discussion). 




Fig. 2. Outer bound ( I21t . rate region achievable with one-round ( 123b and two-round ( 125b strategies and with no cooperation 

(Ci2 = C21 ~ 0) for Ro — 0, and a symmetric scenario with Pi = P2 ~ 5dB, 7^2 = 721 ~ —SdB, jfi — 7I2 = OdB, 
C21 = C12 = 0.5. 



B. Numerical results 

Since the rate region expressions provided for the outer bound and the one -round and two- 
round achievable schemes give little insight, in this section we present numerical results to see how 
much gain is obtained via decoder cooperation. In Fig. [21 we consider a symmetric scenario with 



Pi = P2 = 5 dB, 7^2 = 7|, = -3 dB, -fl = 7^2 = dB, G 



21 



c 



12 



0.3, and we plot the outer 



bound (|2T|) . the rate region achievable with one-round (1231) and two-round (1251) conferencing as 
well as with no cooperation (Cu = C21 = 0) (obtained from either (l23l) and (l25l) ) for _Ro = (so 
that selecting P/ = P^ is sufficient in all the capacity regions). It can be seen that cooperation via 
conferencing decoders enables the achievable rate region to be increased both in terms of sum-rate 
and individual rates. Moreover, the two-step strategy provides relevant gains with respect to the 
one-step approach, while still not achieving the outer bound (|2T1) . 
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Fig. 3. Sum of the private rates Ri + R2 (with Rq = 0) versus the conferencing link capacity C21 for the outer bound Mi\ . the 
one-round l l23t and two-round M5\ strategies and with no cooperation (Pi — P2 ~ lOdB, 7^2 ~ OdB, 7I2 — OdB, 7I1 — SdB, 



7ii 



-3dB, Cv 



0.2). 



Fig. [3] and Fig. |4] show the sum of the private rates R1 + R2 (with Rq = 0) versus the conferencing 
link capacities C21 and C12, respectively, for the outer bound (|2T1) . the achievable schemes with one- 
round (l23l) and two-round (l25l) conferencing and with no cooperation. In both figures, we consider 
cases in which receiver 1 has a worse signal quality than receiver 2 (stochastically degraded): 
P^ = P2 = lOdB, 7^2 = OdB, 7I2 = OdB, 7I1 = -3dB, 7^^ = -3rffi. Fig. [3] shows the 
achievable sum-rates versus C21 for (7i2 = 0.2. It is seen that if C21 = the upper bound coincides 
with the rate achievable with no cooperation, showing that if the link from the "good" receiver 
to the degraded receiver is disabled, the performance is dominated by the worse receiver and 
there is no gain in having C12 > 0. Increasing C21 enables the rate of the worse receiver to 
be increased via cooperation, thus harnessing significant gains with respect to no cooperation. 
In particular, it is seen that for C21 sufficiently small (here C21 ^0.5) the two-step strategy is 
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Fig. 4. Sum of the private rates Ri + 7?2 (with Ro = 0) versus the conferencing hnk capacity C12 for the outer bound ( I21t . the 
one-round ( 123 l l and two-round ( |25t strategies and with no cooperation (Pi — P2 = WdB, 712 = OdB, 7I2 = OdB, 7I1 — —3dB, 
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optimal, since in this region the perfomiance is dominated by the worse receiver whose achievable 
rate increases linearly with C21 due to cooperation via binning of the message set performed 
at the good receiver. The one-step protocol instead lags behind and its performance saturates at 
C (122P2 + I21P1 + ^''^i+J'h^^ ) - 2.26. Finally, for sufficiently large C21, the achievable sum-rate 
at the worse receiver becomes larger than 2.26 and the performance tends to the sum-rate of the 
best receiver, C (7I2-P2 + 7i2-Pi) + C'12 — 2.4, unless C12 is too large. 

Further insight is shown in Fig. |4] where the rates are plotted versus C12 for C21 = 0.8. We 
notice that for C12 = only the two-step protocol is able to achieve the upper bound, since 
in this regime it is optimal for the good receiver to decode and bin its decision. Moreover, 
similarly, increasing C12 enhances the gain of the two-round strategy over the one-round strategy 
up to the point where the perfomance is limited by the sum-rate at the worse receiver, i.e.. 



by C (Pi (71^^ + 7^2) + P2 (7I1 + 7I2) + ^^2(712721 - 711722)^) ^ 2.48, which coincides with the 
upper bound. 

VII. Conferencing encoders and decoders 

In this section, we extend the capacity results of Sec. |W] to the scenario in Fig. [5] in which 
instead of having a common message (as in the previous sections), the encoders are connected 
via conferencing links of capacity C12 and 6*21. Here, each encoder has only one message Wi 
of rate Ri (i = 1, 2) to deliver to both decoders. We refer to this channel as a compound MAC 
with conferencing decoders and encoders (for short, the CME channel). Definitions of encoders 
and conferencing at the transmission side follows the standard reference [1] (see also [3]). A 
((2"^^, 2"^2), n, K, K) code for the CME channel consists of 2K "conferencing" functions at the 
encoders, where K is the number of conferencing rounds between the transmitters [k = 1,2, ..., K): 

Kk- Wi X V2,i X ■ ■ ■ X V2,fc-i ^ Vi,fc (32a) 

Kk- W2 X Vi,i X ■ ■ ■ X Vi,fc_i ^ V2,fc. (32b) 

with alphabets Vj^ {k = 1,2, ...,K) satisfying the capacity budget on the conferencing links: 

K K 

5^|Vi,fc| < nCu and J^lVa,^! < nC2i, (33) 

fc=i fc=i 

and encoding functions: 

/i: Wi X Vi ^ A'l" (34a) 

/2: W2 X Vf ^ X^. (34b) 

It is noted that encoding takes place after the K conferencing rounds at the transmit side, similar to 
the operation at the receivers where decoding occurs after the K decoder-side conferencing rounds. 
Decoding and conferencing at the receiver side are defined as in Sec. HI] (by setting the common 
message Wq to a constant). Achievability of a rate pair (i?i, R2) is defined by requiring the existence 
of a code with such rates and with a vanishing probability of error on the two messages Wi and 
W2. The capacity region of the CME channel is denoted as Ccm£;(C'i2) C'21, C12, C21). 



An outer bound can be established similarly to Proposition I3.1[ 

Proposition 7.1: We have Ccme (C'12, (521, C'12, C'21) ^ CcME~outiCi2,C2i,Ci2,C2i) with 

CcME~out{Ci2, C21, C12, C21) = {(-Rl, R2)' ((-R12 + -R21), Rl — R12, R2 — R21) 

e CcM-out{Ci2,C2i) where R12 = min{i?i, ^12} 
and R21 = min{i?2, C'21}}, (35) 

where CcM-outiCu, C21) is defined in (fTTI) . It is shown in [3] that with only conferencing encoders 
we have Ccme{Ci2, C'21, 0, 0) = CcME-outiCu, C'21, 0, 0). 

Proof: See Appendix |Vl ■ 

The following capacity results can be established similarly to Proposition 14.11 and I4.2[ respec- 
tively. 

Proposition 7.2: If the CME channel is physically degraded such that (X1X2) —Y1 — Y2 forms 
a Markov chain, then the capacity region is obtained as 

CcME-DEg{Ci2, C21, C12, C21) = CcME-out{Cl2, C21, C12, 0). (36) 

Notice that here p*{yiy2\xi,X2) = p{yi\xi, X2)p{y2\yi) due to degradedness. A symmetric result 
holds for the physically degraded channel (X1X2) —Y2 — Y1. 

Proof: The converse follows from the same reasoning used in Proposition 14. II and Proposition 
16. 3[ Achievability is obtained by using a scheme similar to Proposition 14. 1 1 with the only difference 
being that here transmission is performed according to the optimal strategy for a MAC with 
conferencing encoders [1] (see also Theorem 2 in [3]). It is noted that this strategy requires only 
one conferencing round at the encoders, K = 1. ■ 

Proposition 7.3: In the case of unidirectional cooperation at the receiver side (C12 = or 
C21 = 0), the capacity region is given by, respectively, 

Ccme{Ci2, C21, 0, C21) = CcME-out{Ci2, C21, 0, C21) (37a) 



or 



CcMe{Ci2, C21, C12, 0) — CcME~out{Cl2, C21, C12, 0). (37b) 



Proof: The proof is similar to those of Proposition 14.21 and Proposition 17.21 
It is finally noted that the outer bound and achievable rates derived in Sec. |V] and Section |Vl] 
can also be extended to the CME channel and the Gaussian CME channel (|20l) following the same 
approach used to derive Propositions 17.21 and Proposition 17.31 that is, by considering the optimal 
coding strategy for the MAC with conferencing encoders [1] (which requires K = 1). In terms 
of the rate regions, this simply amounts to using the same transformation from {Rq, Ri, R2) to 
{Ri, R2) discussed above (see also [3]). For instance, an outer bound on the Gaussian capacity 
region C^^^(C'i2, 6*21, C'12, C'21) can be obtained as 

^cj\/£;-oMt(^i2) C*2i, C12, C21) = {{Ri, R2)' {{R12 + -R21), Ri — R12, R2 — R21) 

^ CcM-outiCi2,C2i) where R12 = mm{Ri,Ci2} 
and R21 = mm{R2, C21}}, (38) 

and similarly for the rate regions achievable with the one-round and two-round receiver-side 
conferencing strategies ( (l23l) and (1251) ) coupled with the optimal transmit cooperation [1]. 

Remark 7.1: {Conferencing encoders vs. conferencing decoders) While no general capacity re- 
sults have been derived that enable a conclusive comparison between the performance of confer- 
encing encoders or decoders in the compound multiple access channel, some basic conclusions can 
be drawn based on the analysis above. To start with, conferencing decoders tend to behave like a 
multi-antenna receiver for large conferencing capacities and thus, as discussed in Sec. |VIl have the 
potential for increasing the multiplexing gain of the sum-rate up to the maximum value of two. In 
contrast, it can be seen from the outer bound (l38l) that conferencing at the encoders alone does not 



have such a potential advantage, as the coherent power combining afforded by cooperating encoders 
is not enough to increase the multiplexing gain of the systenij. However, this does not necessarily 
mean that decoder conferencing is always to be preferred to encoder conferencing. Consider for 
instance the case of unidirectional links, where say (721 = C21 = 0, so that conferencing links 

^It is noted that this conclusion would be significantly different for an interference channel, since in this case conferencing 
at the encoders has the capability of creating an equivalent two-antenna broadcast channel with single-antenna receivers, whose 
multiplexing gain is known to be two. 
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Fig. 5. A discrete-memoryless compound MAC channel with conferencing decoders and encoders (for short, CME). 



exist only from encoder 1 to encoder 2 on the transmit side and from decoder 1 to decoder 2 
on the receive side. In this case, the capacity region is given in Proposition 17.31 and one can see 
that, e.g., for a symmetric system (7^^ = 7^2, 7I1 = 7i2 and Pi = P2), the conferencing link at the 
decoders alone never helps increase the achievable rates, while the conferencing link at the transmit 
side can always enlarge the achievable rate region. Further performance comparison is carried out 
numerically below. 



A. Numerical results 

In this section, we present a numerical example related to the scenario in Fig. [5] for the Gaussian 
CME channel (l20l) . Fig. [6] shows the outer bound (|38l) evaluated for encoder-side {C12 = C21 = 0), 
decoder-side (C12 = C21 = 0) or both-side conferencing, along with the rate regions achievable 
with one-round and two-round strategies and with no cooperation for Pi = P2 = 5dB, 7^2 = 
721 = —SdB, 7^1 = 7I2 = OdB, and conferencing capacities (when non-zero) C21 = Cu = C21 = 
C\2 = 0.3. Considering first the outer bounds, it can be seen that both conferencing at the encoders 
and decoders have the same potential in terms of increasing the rates R\ and i?2, whereas for 
this example the outer bound corresponding to decoder- side cooperation leads to a larger sum-rate 
Ri + R2- Comparison of achievable rates via one or two rounds of conferencing at the receiver side 
(recall that one round of encoder conferencing is enough to achieve all the rate points discussed 



1.2- 



0.8 



0.6 



0.4- 



0.2 



- 


-^ 


^^--^~~~~.^ 


:___. 




outer bound "~~, 


- 




(q2=c2,=o) 


no 


cooperation 


(C, 


= c„ 


= C,j=Q, = 0) 


- 




1 



0.2 0.4 




0.6 0. 



Fig. 6. Outer bound J38t evaluated for encoder-side (C12 = C21 = 0), decoder-side (C12 = C21 = 0) or both-side conferencing, 
along with the rate regions achievable with one-round and two-round strategies and with no cooperation for Pi = P2 ~ 5dB, 
7i2 — 721 = ~3dB, 7ii = 722 ~ OdB, and conferencing capacities (when non-zero) C21 ~ C12 ~ C21 = C12 = 0.3. 



here) is similar to that seen in Fig. [2l 



VIII. Conclusions 

The model of conferencing encoders and/or decoders is a convenient framework that allows 
evaluation of the potential gains arising from cooperation at the transmitter or receiver side in a 
wireless network. From a practical standpoint, it accounts for scenarios where out-of-band signal 
paths exist at the two ends of a communication link, as is the case in wireless communication 
systems where nodes are endowed with multiple radio interfaces. In this work, we have contributed 
to the state of knowledge in this area by investigating a compound MAC with conferencing decoders 
and, possibly, encoders. The compound MAC can be seen as a combination of two single-message 
broadcast (multicast) channels from the standpoint of the transmitters, or two multiple access 
channels as seen by the receivers. The scenario at hand generalizes a number of previously studied 



setups, such as MAC or compound MAC with common message or conferencing encoders and 
single-message broadcast channel with two conferencing decoders. A number of capacity results 
have been derived that have shed light on the impact of decoder and encoder conferencing on 
the capacity of the compound MAC. Among the conclusions, we have shown that in a compound 
Gaussian MAC, one round of conferencing at the decoders achieves the entire capacity region 
within a constant number of bits/s/Hz in several special cases. One round of conferencing at 
the transmitters is also optimal in all the cases where the capacity region is known. Moreover, 
comparing the performance of conferencing at the encoders and decoders, it has been pointed out 
that examples can be constructed where either one outperforms the other. However, in the Gaussian 
case, while conferencing at the decoders has the potential of increasing the sum-rate multiplexing 
gain to the optimal value of two by mimicking a multiantenna receiver, the same is not true of 
conferencing encoders, since coherent power combining afforded by cooperating encoders is not 
enough to increase the multiplexing gain beyond one (recall that the two decoders must estimate 
both messages). 

As a possible extension of this work we mention the study of an interference channel, rather 
than the compound MAC, with conferencing decoders. As already pointed out in the paper, some 
of the conclusions here would be significantly different in this case, and the analysis could benefit 
from the techniques used in [17] [18] to study interference channels with no cooperation. 

Appendix I 
Proof of Proposition 13JJ 

In order for rates {Rq, Ri, R2) to be achievable, the probability of error P^ needs to satisfy ([5]) 
which, by the union bound, is implied by Pe,j < £^/2 for i = 1, 2 with 

^e.i = ^niR^ln.^R.) E ^Ah,{Y-, V,') y^w\w sent] 

«ieWoxWixW2 

and similarly for Pg 2- Consider the first receiver. By Fano's inequality, we have 

H{Wo, W,, W2\Y(', Vf) < H{P,^^) + n{Ro + R, + R2)Pe,i = nd^ (39) 



with 5„ — > as n — > oo. It also follows that 

H{W^W2\Y,\ V^f , Wo) < nS^, (40a) 

HiWilY;", Vf, Wo, W2) < n6n and (40b) 

H{W2\Y,^, V^, Wo, Wi) < n6n. (40c) 

Now, from (|39l ). we have 

n{Ro + Ri + R2) < I{Wo, W,, W2; Vr, Vf) + n5n 

< I{Wo, Wu W2; n") + I{Wo, Wi, W2; ^'^in") + n6n 

< I (Wo, W,, W2; n") + nC2i + n5n 

(b) " 

< 22^iXi,i, X2,i; n.^) + nC2i + n5n, 

where (a) follows from the fact that I{Wo, Wi, W2; V^\Y^) < H{V.^) < nC2i and (b) is obtained 
similarly to [1], Sec. 3.4. From (|40|) . using similar arguments as in the above chain of inequalities, 
one can also obtain 



{Ri + R2) < J2^{Xl,^, X2X, Y^^,\Wo) + nC2i + ndn, 

i=l 
n 

nRi < ^J(Xi,i; Yi,i|X2,i, Wo) + nC2i + n5n and 



i=l 



nR2 < ^I{X2X, Fi,»|Xi,„ Wo) + nCsi + n5^ 



i=l 



Now defining f/, = Wq, the proof is completed as in [3]. We can repeat the same arguments 
for receiver 2. Also the condition that {Ro, Ri, R2) G TZmacfc follows similarly considering full 
cooperation between the receivers. 

Appendix II 
Proof of Proposition 14. II 

Converse: The converse follows immediately from Proposition 13.11 and the data processing 
theorem. In fact, it is easy to see that, because of physical degradedness, receiver 1 cannot benefit 



from V^ , which is a function of Y^ and F" via Vi- For instance, condition (|39| ) now becomes 

H{Wo, Wu W2\Yn = H{Wo, W,, 1^2^", Vf) < H{P,,,) + n{R, + i?2)Pe,i = ri<5„, 

due to the Markov chain (VFq, W^i, ^^2) — ^i" — V^ . Repeating the same arguments for the other 
conditions (|40l) . the converse is then completed as in Proposition |3.1[ 

Achievability: Codeword generation at the transmitters is performed as for the MAC with common 
information [1] [13]: 

Generate 2"^" sequences u^{'Wq) of length n, with the elements of each being chosen independent 
identically distributed (i.i.d.) according to the distribution ]9(m), wq E Wq. For any sequence u"{wo), 
generate 2"^^ independent sequences x^{wo,Wi), Wi e Wj, again i.i.d. according to p{xi\ui{wo)), 
for z = 1,2. 

At receiver 1, the message sets Wo, Wi and W2 are partitioned into 2'^°'°^^\ 2""i^i2 ^nd 2""2Ci2 
subsets, respectively, for given < «» < 1 and X]j=o'^* ~ ^- ^^^^^ is done by assigning each 
codeword in the message sets Wo, Wi and W2 independently and randomly to the index sets 
{l,2,...,2""o^i2}^ {l,2,...,2""i^i2} and {1,2, ...,2""^^^'^^}, respectively. 

Encoding at transmitter i is performed by sending codeword x^{wo,Wi) corresponding to the 
common message wq G Wo and local message Wi E Wi {i = 1,2). Encoding at decoder 1 takes 
place after detection of the two messages Wq, Wi and W2 (see description of decoding below). In 
particular, decoder 1 sends over the conferencing link 1-2 the indices of the subsets in which the 
estimated messages Wq, Wi and W2 lie. Notice that this requires nCu bits and K = 1 conferencing 
rounds (i.e., |Vi,i| = nCu). Also we emphasize again that the conferencing link 2-1 is not used 

(|V2,fc| = 0). 

Decoding at the first decoder is carried out by finding jointly typical sequences (u'^(wo), Xi{wo, wi] 
X2{wo,W2), Vi) with Wi E Wj [11]. As discussed above, once the first decoder has obtained 
the messages Wq, Wi and W2, it sends the corresponding subset indices to receiver 2 over the 
conferencing channels. Decoding at receiver 2 then takes place again based on a standard MAC 
joint-typicality encoder with the caveat that the messages Wq, Wi and W2 are now known to belong 
to the reduced set given by the subsets mentioned above. 

The analysis of the probability of error follows immediately from [1] [13]. In particular, as far 



as receiver 1 is concerned, it can be seen from [1] [13] that a sufficient condition for the probability 
of error to approach zero as n — > oo is given by {Rq, Ri, R2) G TlMAc,iipiu),p{xi\u),p{x2\u)). 
Considering receiver 2, a sufficient condition is that the rates belong to the region 

{(i?o, Ri, R2): Ro > 0, Ri> 0, R2 > 0, (41a) 

Ri < I{Xi- Y2\X2U) + aiCi2 (41b) 

R2 < /(X2; Y2\X^U) + a2Ci2 (41c) 

Ri + R2< HX1X2; Y2\U) + (ai + a2)Ci2 (41d) 

Ro + Ri + R2< /(X1X2; Y2) + C12}, (41e) 

for the given aj. Taking the union over all allowed ttj in (|4TI) concludes the proof. 

Appendix III 
Proof of Proposition 16.41 

We first prove that Ri^oR > Ri,out — |- We consider three separate cases and show that the 
statement of the theorem holds for each case separately. We define Pa = 7ii-Pi, Pb — 7i2-Pi; 
C12 = 2^'^i2 _ I and C21 — 2^'"2i _ i for simplicity of notation. We remark that using this notation 

(i+n)ci2 ^"^ ^2 (i+p,)P2i • 



the compression noises (|24)) can be written for the case at hand as aj = },^^pt^'' and af — ^+-P''+-P'' 



Cai'g i: Let 



and 



Cn > ^ (42) 



Cn > ^. (43) 



In this case, the upper bound (l28l) is -Ri_oMt = | log(l + Pa + -Pb) and for the achievable rate with 
one-round conferencing (|29l) we have 



I + .I; 2 »V ° 1 + ^ 



> Rout ~ 77- 



where (l44l) follows from (|42l) . Similarly, using (|43l) . we can also show that C lPb + j^ 



R, 



\. It then follows that Ri out > Rout — h- 



out 2 

Case 2: Now, let 



> 



Coi < 



l + Pa 



and 



(45) 



(1 + Pj(l + C2l)<(l + P6)(l + Ci2). 

In this case, we have Ri^out = |log(l + Pa)(l + C'21) and 



C{Pa + 



l + al 



2log(l + P. + - 



l + Pg+Pb 
P2l{l + Pa). 



PbQ 



b'^21 



- log (1 + Pa) + - log I 1 + 



:i + Pa + Pb)il + C2l) 



1 1 
- log (1 + Pa) + - log 

2 ""^ ^2 ^\(l + PjC2i + (l + P. + P,; 



-l0g(l + Pa)(l+C21 



-log 
2 ^ 



1 + Pa + A 



;i + Pa)C721 + (l + Pa + A: 



> Po«t + - lo; 



^ Pojit ~ 



1 + Pg + Pb 
1 + Pa + 2Pb 



(46) 



(47) 
(48) 



where (l47l) follows from (l45l). On the other hand, we also have 



\ ^ Pl2{l+Pt) 



c(n+ ^"^ 



l + at 



^log 



:i + P6 



p. 



i + p. 



l + Pa+Pb 
C2I 



>ilof 



log 



(1 + n) 1 + 



Pj(l + P„)(l + C2l)-(1 + A)] 



;i + p,)[(i + p,)(i + C2i) + pj 
;i + pj(i + (72i)(i + Pa + n) 



(49) 



:i+pj(i+c2i)+p„ 



-RoMt + ^ lo; 



> -Ro«t + - log 



l + Pa + Pb 



L(l + Pa)(l + P2l)+Pa, 
" 1 + P, + Pb " 



1 + 2P, + Pb 



(50) 
(51) 



where ([491) follows from (|46l); and dSO]) follows from (|45l) . From (I48]) and (|5T]) . we see that the 
theorem holds for Case 2 as well. 
Case 3: Let 

Pn 



Cio< 



1 + pb 



and 



;i + Pfe)(l + (7i2)<(l + Pa)(l + C'2l). 



(52) 



(53) 



In this case, Rout = | log(l + Pb){^ + C^)- Case 3 follows similarly to Case 2. 

Now, for the symmetric channel case, i.e., 7^^ = 7^3, that is, if Pa = Pb — P, we have to prove 
that RoR > Rout — 0.29. This follows similarly to the treatment above as 

Rn R > Rnut — - lo, 



Rout - - l0£ 



>P„„i--(log3-l). 



\l + Pa 


+ A1 


_l + 2Pa + Pb_ 


'1 + 2P" 




1 + 3P 





(54) 



Appendix IV 
Proof of Proposition [63] 

To prove the theorem, we show that the bounds for Pi, P2 and R1 + R2 in Cqj^{C) are all within 
°^^ ' bits of the corresponding bounds in C^M-outi^)- ^^ define C = 2^^^ — 1. Without loss of 



generality, we assume b > a, and define x = aP. Tlien from tlie definition of /5, we get hP = (3x. 
The outer bound and tlie acliievable rates witli one-round conferencing can now be written as 

C^CM-out{C) = {{RuR2) ■■Ri>0,R2> 0, 

Ri < min{C(a;) + C, C((l + (3)x)}, (55a) 

i?2 < min{C(a;) + C, C((l + /3)x)}, (55b) 

Ri + R2< min{C((l + P)x) + C, C(2(l + P)x + (/3 - l)'^^)}}, (55c) 



and 



KRiC) = {{Ri,R2)--Ri>o, i?2>o 

A 

1+(T 

A 



Ri<C{{l + ^^ ]x], (56a) 

i?2 < C ( ( 1 + -r^ ]x], (56b) 



i...;j,,c((l + ,3.i±|+(4^).)} (560 

^^* ^' = \,;lJ;y ^ respectively. 
We first define functions A and B as 

A(a;) = l + (l + /5)a; 

and 

B{x) = l + 2{l+(3)x+{f3-lfx^. (57) 

Consider the bound on Ri. We analyze two cases separately. If (7 > j^, then the outer bound 



is equivalent to i?i < ^ log A. On the other hand, the bound on the achievable i?i is found as 



1 



log I 1 + a; 



px 



l+2{l+l3)x+{t3-iyx2 



1 + 



(l+(l+/3)x)C 



1 , / P^Ax' 

^-2''^V^''^ PAx+{l + x)B 



>llo, 



A 



(/52 + (3)x^ + /3x + (1 + xf (l + ^x) 



l3Ax + (1 + x)B 



1 A 
> - log 

= -\ogA--log{l + P). 



(58) 



If C* < j^, then the outer bound is equivalent to i?i < ^ log((l + (7)(1 + x)). The achievable rate 
bound can be written as 



1 , / px 



1, (1 + x)(AC + B) + pACx 

= - log z 

2 ^\^ AC + B 

>2Ml + a:)Y^ 

= ilog(l+x)(l + C')-ilog(l + /?). 



(59) 



Combining (|58] ) and (|59l) . we conclude that the difference between the achievable rate bound and 
the outer bound on Ri is not more than | log(l + P) bits. The same result applies for the bounds 
on R2 in the same way. 



Next, we consider the bounds on the sum-rate. If C* > ^-^, then the outer bound on the sum-rate 



is equivalent to Ri + R2 < h logB. On the other hand, the bound on achievable sum-rate is 



^log 



l + (l + /?)x 1 



1 + a' 



2^2 



> -log 

- 2 ^ 



l + (l + /?)x 1 + 



{f3 - 1) V 

(/? - 1)2x2 



2 + 



+ 



B-A 



2 + 



B-A 



1, / . ^-^ 



B-A 



= — log I 

2 ^V25-A 

1, 1 

> -logB - -. 

- 2 ^ 2 



(60) 



If C* < ^-T^, then the sum-rate outer bound is equivalent to Ri + R2 < 5log(l + C)A. The 



achievable sum-rate bound is 

l + {l + (3)x[l + 



^log 



1 



2^2 



(/5 - Ifx 



1, 

> -l0£ 

- 2 ^ 



loe 



1 + ^2 

/2C'A + 5 
yCA + E 

AC{B-A) 



l + {l + f3)x 
A + 



+ 



1 + ^2 

{(3 - ifx^CA 
CA + B 



log 



>\^o, 



AC + B 

AB{1 + C) 
AC + B 



A{l + C) 



B 



2B-A 



>UogA{l + C)-^. 



(61) 



From (1601) and (1611) . we see that the difference between the achievable sum-rate bound and the 
sum-rate outer bound is always within half a bit. The claim for the case a = b can be similarly 
proved. This concludes the proof. 



Appendix V 
Proof of Proposition 17. II 

In order for rates (Ri, R2) to be achievable, by Fano's inequality, we have for the first receiver 
(see also proof of Proposition 13. II) : 

H{Wi,W2\Y,^,V^'')<nSn (62) 

with (5„ — ^ as n — > 00. From the previous inequality, it also follows that (i = 1, 2) 

H{W,, W2\Y^, Vf, Vf, V/) < n5„, (63a) 

HiWilYI", vf, vf, vf, W2) < n5n and (63b) 

H{W2\Y^, vf, vf, Vf, Wr) < n5^, (63c) 

where Vf , Vf represent the signals exchanged during the K encoder- side conferencing rounds. 
Now, we can treat (|62l)-(|63]) similarly to the proof of Proposition 13.11 and using the approach in 
[1]. For instance, from (I63al) . we have 

n{Ri + R2) < I{Wi, W2; n", vf, vf, Vf) + nSn 

< I{W^, W2; Y^\vf, vf) + I{W^, W2; vf, vf) 

+ I{W^, W2; Vf\Yl\ vf, vf) + ndn 

< I{Wi, W2; Y^\vf, vf) + n{Ci2 + C21) + nC2i + n5n 

(6) " _ _ _ _ 

< 5^/(Xi,„ X2,.; Y^^^Vf, Vf) + n{Ci2 + C21) + nC2i + n5n, 

i=l 

where (a) follows from the fact that I{Wi,W2;Vf,Vf) < H{Vf,Vf) < n{Ci2 + C21) and 
I{Wi,W2;Vf\Y-[',Vf,Vf) < Hiyf) < nC2i, and (b) is obtained similarly to [1], Sec. 3.4. 
From (|62l) and the remaining inequalities in (|63l) , using similar arguments as in the above chain of 



inequalities, one obtains, respectively, 

n 

i{Ri + R2) < J2^{Xl^^, X2/, Yi^,) + nC2i + nSn, 



n( ^ _^ _ 



nRi < $^/(Xi,,; Yi,,\X2,i, Vf, Vf) + nCu + riCsi + nSn and 

n 

nR2 < 5^/(^2,; n,|Xi„ vf, vf) + nC2i + nCsi + n<5„. 

i=l 

Now defining [/j = {Vf, Vf), the proof is completed similarly to Proposition 13 .![ and by repeating 
the same arguments for receiver 2. 
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